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Abstract — We consider the capacity of memoryless finite-state 
multiple access channel (FS-MAC) with causal asymmetric noisy 
state information available at both transmitters and complete 
state information available at the receiver. Single letter inner 
and outer bounds are provided for the capacity of such channels 
when the state process is independent and identically distributed. 
The outer bound is attained by observing that the proposed inner 
bound is tight for the sum-rate capacity. 

I. Introduction and Literature Review 

Modeling communication channels with a state process fits 
well for many physical scenarios. For single-user channels, 
the characterization of the capacity with various degrees of 
channel state information at the transmitter (CSIT) and at the 
receiver (CSIR) is well understood. Among them, Shannon 
U] determined the capacity formula when causal noiseless 
state information is available at the transmitter, where state is 
independent identically distributed (i.i.d.). The same problem 
with non-causal side information is considered in 0. In J3|, 
Shannon's result is extended to the case where noisy state 
observation is available at both the transmitter and the receiver. 
Later, in [4] this result has been shown to be a special case of 
Shannon's model and the authors also determined that when 
CSIT is a deterministic function of CSIR optimal codes can 
be constructed directly on the input alphabet. 

In the multi-user setting, [5| provides a multi-letter char- 
acterization of the capacity region of time-varying multiple 
access channels (MACs) with various degrees of CSIT and 
CSIR. In f6l. a general framework for the capacity region 
of MACs with causal and non-causal CSI is presented. In 
a related work, MACs where the encoders have degraded 
information on the channel state, which is coded to the 
encoders, is considered Q. In JS], memoryless FS-MACs with 
two independent states (see also [9| for the single state case), 
each known causally and strictly causally to one encoder, are 
considered and an achievable rate region, which is shown to 
contain an achievable region where each user applies Shannon 
strategies, is proposed. In JS] and it is also shown that 
strictly casual state information does not increase the sum-rate 
capacity. More recently, in iflOl finite-state Markovian MACs 
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with asymmetric delayed state information at the transmitters 
are studied and their capacity region is determined. 

The most relevant work to our paper is lITD . which obtained 
a single letter characterization of the capacity region for 
memoryless FS-MAC in which transmitters have asymmetric 
partial quantized state observations and the receiver has full 
state information. In this work, the authors were inspired from 
team decision theory 1121 . |[T3l . We herein mainly adopt the 
converse technique presented in [11] and partially extend it 
to a noisy setup. The present paper, thus, studies the FS- 
MAC in which each of the transmitters have an asymmetric 
state information which is corrupted by an i.i.d. noise process 
and the receiver has complete state information. We provide 
a single letter inner bound to the capacity region, in terms of 
Shannon strategies [1]. By observing that this inner bound is 
tight for the sum-rate capacity, we also provide an outer bound 
to the channel's capacity region. We modify the approach in 
ifTTI to account for the fact that the decoder does not have 
access to the state information at the encoders, and that the 
past state information does not lead to a tractable recursion. 

The rest of the paper is organized as follows. In Section [TT] 
we formally state the problem, present inner and outer bounds 
to the capacity region with the achievability and converse 
proofs and in Section UIT1 we present concluding remarks. 

Throughout the paper we will use the following notations. A 
random variable will be denoted by an upper case letter X and 
its particular realization by a lower case letter x. For a vector 
v, and a positive integer i, Vi will denote the i-th entry of v, 
while vu] = («!,••• , will denote the vector of the first i 
entries of v. For a finite set A, V(A) will denote the simplex 
of probability distributions over A. Probability distributions 
are denoted by P(-) and subscripted by the name of the 
random variables and conditioning, e.g., P UT \ VS (u,t\v,s) 
is the conditional probability of (U — u,T = t) given 
(V = v,S = s). Finally, for a positive integer n, we shall 
denote by A^ := Uo<s<n A s the set of ,4-strings of length 
smaller than n. We denote the indicator function of an event 
by !{£}■ All sets considered hereafter are finite. 
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Fig. I. The multiple-access channel with noisy state feedback. 



II. On the Capacity of FS-MAC with Noisy CSIT 
and Complete CSIR 

Consider a two-user memoryless FS-MAC, with two en- 
coders, a, b, and two independent message sources W a and 
Wb which are uniformly distributed in the sets W a G 
{1, 2, • • • , M a ] and W b € {1, 2, • • • , M b }, respectively. The 
channel inputs of the encoders are X a and X b , respectively. 
The channel state process is modeled as a sequence {St}^i 
of i.i.d. random variables in some space S. The two encoders 
have access to causal noisy version of the state information St 
at each time t > 1 modeled by Sf G «S°, S b S S b , respectively 
and as such the joint distribution of (St, Sf, S b ) satisfies 



P, 



s?,s?,s 



(s?,s b t ,st) = P s?lSt (s?\st)Ps>\sM\ s t)PsAst). (1) 



We also assume that St is fully available at the receiver (see 
HJ and that (S t , Sf, S?) are independent of (W a ,W b ) Mt > 1. 
The channel inputs at time t, i.e., Xf and X b , are functions 
of the locally available information {W a ,S?^) and (W b ,S\ 



Let W := (W a ,W b ) and X := (X a ,X b ). Then, the laws 
governing n-sequences of state, input and output letters are 
given by 



P 



Yj n] |w,x w ,fir w ,sg, ] ,s 1 



f„,(!/[n]l w ' x M' s [»]' s H' s H) 

71 

= n P Yt\X? l X},S t (yt\ x t> x ti s t), ( 2 ) 
t—1 

where the channel's transition distribution, 

P Y t \x?,x*,S t {yt\ x t' x t, s t)> is g iven a P riori - 

Definition 1: An (n, 2 nRa , 2 nRb ) code with block length n 
and rates (R a , R b ) for an FS-MAC with noisy state feedback 
consists of 



(1) A sequence of mappings for each encoder 

4 a} : (S a Y x W a 
. /o6^t 



X ai t = 1,2, ...n; 
. . xWi^4 i=l,2,...n. 
2) An associated decoding function 

ip : (S) n x y n 4W a x w 6 . 



2n(R a +R b ) 

i i 



P(i)(Y [n] ,S [n] )^(w a ,w b )\W 



A rate pair (i? a , R b ) is achievable if for any e > there exists, 
for all n sufficiently large, an (n, 2 nRa , 2 nRb ) code such that 
i log M a >R a >0,^ log M 6 > R b > and P e (n) < e. The 
capacity region of the FS-MAC, Cfs, is the closure of the set 
of all achievable rate pairs (R a , R b ) and the sum-rate capacity 
is defined as C£- s := max( flaifl() ) 6CFS (R a + R b ). 

Before proceeding with the main result, we introduce mem- 
oryless stationary team policies 111 11 and their associated rate 
regions. We first define Shannon strategies. 

Definition 2: Let the set of all possible functions from <S a 
to X a and S b to X b be denoted by T a and T b , respectively, 

where T a = A" 1 ' 5 " 1 and T b = X blS " 1 . Let T a E T a and 
T b G T b be two T a -valued and T b -valued random vectors, 
respectively, referred to as Shannon strategies. 

Definition 3: ifTTl A memoryless stationary (in time) team 
policy is a family 

n = {7T = (7TT»(-), TTriO) S V(T a ) X ^(T")} (3) 

of probability distributions on the two sets of random func- 
tions. For every memoryless stationary team policy tt, 1Z(tt) 
denotes the region of all rate pairs R = (R a ,R b ) satisfying 

R a < I(T a ;Y\T b ,S) (4) 
R b < I{T b ;Y\T a ,S) (5) 



Ra + Rb < I(T a ,T b ;Y\S) 



(6) 



where S, T a , T b and Y are random variables taking values 
in S, T a , T b and y, respectively and whose joint probability 
distribution factorizes as 



P. 



b , Y (s,t a ,t b ,y) 



S,T",T 

= Ps(s)P Y \T«,TKs(y\t a , t\ s)k t « (t a )ir Tb (t»). (7) 

We can now state the inner bound to the capacity region. Let 

Cin := co^ IJ^ TZ.(tt) \ denotes the closure of the convex 

hull of the rate regions 1Z(tt) given by ©-(O associated to 
all possible memoryless stationary team polices as defined in 
®. 

Theorem 1 (Inner Bound): C/jv Q Cfs- 
The achievability proof follows the standard arguments of joint 
e-typical n-sequences fl4\ Section 15.2]. 

Definition 4: Q3] Section 15.2] The set A" of e-typical n- 
sequences {(xl • • • , xf ,)} with respect to the distribution 



Al l 



, X 



is defined by 

) G X 1 x ■ • • X k 



\--log(P(s))-H(S)\ <e,VSC{x\ 

where s denotes ordered set of sequences in xli 
corresponding to S. 



,X k } 



Proof of Theorem^!} Fix (R a ,Rb) G 1Z(it). 
Codebook Generation Fix ttt" (t a ) and ir Tb (t b ). For each 
w a G {1, • • • , 2 nRa } randomly generate its corresponding n- 
tuple tf n] wa , each according to n"=i J- Similarly, 

For each u>6 G {1, • • • 7 2 niib } randomly generate its corre- 
sponding n-tuple t b [nlwb , each according to n?=i n?* (*£,«,,,)• 
These codeword pairs form the codebook, which is revealed 
to the decoder while codewords t\ is revealed to encoder /, 
l = {a,b}. 

Encoding Define the encoding functions as follows: 

xUwa) = aft) = tl Wa (s?) and x\{w b ) = 

^(W6,«f fl ) = where t? Wa and t\ Wb denote the 

ith component of i? , Wa and tf, Wb , respectively, and sf 
and s b denote the last component s%, and sj^, respectively, 
i = 1, • • • , n. Therefore, to send the messages w a and Wb, 
we simply transmit the corresponding t?, ^ and , ^ 
respectively. 

Decoding After receiving (yr n ], Sr n i), the decoder looks for 
the only (u> ,w 6 ) pair such that (t[ nlWa ,t b [n]wb ,y [n] , s [n] ) 
are jointly e— typical and declares this pair as its estimate 

(w a ,w b ). 

Error Analysis Without loss of generality, we can as- 
sume that (w a ,wt,) — (1,1) was sent. An error occurs, 
if the correct codewords are not typical with the received 
sequence or there is a pair of incorrect codewords that 
are typical with the received sequence. Define the events 
E a ,pH(T^ a ,T b n] p ,Y [n] ,S [n] ) G A?}, a G {l,--- ,2"*-} 
and (3 G {1, • • • , 2 nRb }. Then by the union bound we get 

Pe = P{Kl U ^ 

(cc^)jt(l, 1) 

+ e p ( E ^) + E p (^) 



Q= l,/3^1 



E 



(8) 



where P(Ef x ) denotes the probability that no message pair is 
jointly typical. It can easily be verified that {Yi, S it Tf, T*}^ 
is an i.i.d. sequence and by lfl4l Theorem 15.1.2], P(Ef x ) — ► 
for sufficiently large n. Next, let us consider the second term 

E P{E a=W ) 

= E P(( T [n],l^ T [n],l3^ Y ln],S[ n ]) e A™ ) 
a=l,/9^1 

= E E ^ 

a=l,/9#l (tf rl] ,tf 7l] ,i/ H ,s H )6A« 

PT [ a n] ^W.S[nl(*fn]>2/N> s M) 

< | j 4ri| 2 -r l [//(T 6 )- e ] 2 -«[_f/(TM',S)-e] 

< 2™-R6 2~™[ ff ^ T ^ + - f/ ( Ta ' Y, ' s, )~- ff ( Ta,T!, ' Y, ' s, )~ 3 ' s l 

(») 2 »[i?. b -/(T b ; y|s,T' l )-3 e ] (9) 

where (i) holds since for f3 ^ 1, TP-, ^ is independent 

of (T, a n] v Y [n] ,S[ n ]) and (m) follows since T b and (T Q ,5) 



are independent and I(T b ; Y, T a , S) = I(T b ;T a ,S) + 
I(T b ;Y\T a ,S) = I(T b ;Y\T a ,S), where I(T b ;T a ,S) = 0. 
Following the same steps for (a ^ 1, (3 = 1) and (a ^ 1, f3 ^ 
1) we get 

E P ( E ^P) < 2"[ R »- J ( r °' y l T6 - s )- 3e ], 

E P (^) < 2"^+^- 7 ( Ta ' T ^ Y l s )- 3£ ],(10) 

and the rate conditions of the 7£(7r) imply that each term tends 
in (0 tends to zero as n — > oo. This shows the achievability 
of a rate pair (R a , Rb) G 1Z(n). Achievability of any rate pair 
in Cin follows from a standard time-sharing argument. ■ 
We now present an outer bound to Cfs, which is obtained by 
providing a tight converse to the sum-rate capacity. Let 



a 



OUT 



{R a ,Rb) g m + x n 4 



R a + R b < sup I(T a ,T°- 1 Y\S) 

■K T a(t^)-K Tb (t b ) 



Theorem 2 (Outer Bound): Cfs C Cout- 

Proof: We need to show that all achievable rates satisfy 

R a + Rb< sup I(T a ,T b ;Y\S), 

Tr T a(t a )w Tb (t b ) 

i.e., a converse for the sum-rate capacity. We use the converse 
technique of ifTTI and extend it to a noisy setup. Therefore, 
following El] let a CT := ±P Stl _ 1} (v), v(e) := j^log^l + 
-yz^r- Observe that lim £ ^o 77(e) = and 

E = \ E E ^v» = 1 > 

<t6<S(™> l<i<n cre5(t-i) 

where <S(") and tS^ -1 ) are the sets of all 5-strings of length 
n and (t — 1), respectively. First recall that, since = 

4 a) (w a ,Sf t _ lV Sf) and X b = 4>? ] (w b , S\ t _ lY S b ) , we 
have 



T t a = 4 a) (w a ,S? t _ e^ |s °' 



rri6 

1 t — 



^ (w b , 



[t-i] 



G X' 



,\s b 



(11) 



We now show that the sum of any achievable rate pair can 
be written as the convex combination of conditional mutual 
information terms which are indexed by the realization of past 
complete state information. 

Lemma 1: Let T t a G T a and T* G T b be the Shannon 
strategies induced by 0™ and <j>\, respectively, as shown in 
(fTTT >. Assume that a rate pair R = (R a , Rb), with block length 
77 > 1 and a constant e G (0, 1/2), is achievable. Then, 

R a + Rb< E a <y J(T t a ,r t 6 ;y t |5 t ,S [t _i]=(7)+»;(e).(12) 

<t6S(™> 

Proof: Let T t := (T t a ,T t b ). By Fano's inequality, we get 



H(W\Y [n] ,S [n] ) < H(e) + e\og(\W a \\W b \ 



(13) 



Observing that 

I(W;Y [n] ,S [n] ) = H(W)-H(W\Y [n] ,S [n] ) 

= log(|W ||W6|)-lf(W|y N) 5 M )(14) 

Combining ( TT31 and ( TBI gives 

(1 - e) log(| W a 1 1 ml) < /(W; Y [n] , ) + H(e) 

and 

i?a + i?fc = -l0g(|>V Q ||W h |) 

n 

< ^—-(l{W;Y [n] ,S ln] )+H(e)). (15) 
Furthermore, /(W; Yj„j , 5[ n j) can be written as 

5][ff(y tl s t |s N]l y M )-ff(y (1 si|w 1 s [t _ 1]l ^_ 1 ])] 

n 

( => £ [^|5 [t ],Vil) ~ #(^|w,s [t] ,y [t -i])] 
t=i 

(n) 

< £ [H(Y t \S [t] ) - HiYtlW^^Y^Tt)} 



where (a) is valid since J(T t a , T t fc ; r t |5 [t] ) < log|^|. Further- 



(Hi) 



Y,[H(Y t \S [t] )-H(Y t \S [t] ,T t )] 

n 

£/(T t; y t |s [t] ) 



(16) 



where (i) follows from the fact that St is i.i.d. and independent 
of W, in (ii), Tj : — (T®,T b ) are Shannon strategies whose 
realizations are mappings t\ : S\ — > X| for i — {a, b} and 
thus (ii) holds since conditioning reduces entropy. Finally, 
(in) follow since 

Vtlw.St.s^-y.yit-y.T/.T^Cj/tlw.st^ti-il^It-il^t^t) 



more, 

/(r t <\T t fc ; y t |s [t] ) 

= n XI a«,I(^ s r t 6 ;y t |S , t ,5 [t _ 1] =<7) ) (19) 

and substituting the above into ( fl~8l > yields (TT2b . ■ 

Observe now that, for any t > 1, I(T t Q , T t 6 ; y|,S t , 5 [t _!] = cr) 
is a function of the joint conditional distribution of channel 
state St, inputs T t a , T t h and output Y t given the past realization 
(S\t-i] = cr). Hence, to complete the proof of the outer 
bound, we need to show that P T a T b Yt s t |Srt_i] (*t j *t) Vt> s t\ tT ) 
factorizes as in (|7). This is done in the lemma below. In 
particular, it is crucial to observe that the complete state 
observation at the decoder is enough to provide a product form 
on T a and T b . Before stating the lemma, let us introduce some 
more notations. Let cr a and <7b denote particular realizations 
of SSji and St^, respectively. Let 



T«.(f) := {w a : 4 0) K,sf t _i] = a a ) = t°}> 



T» b (i b ) := { Wb : 4 b \w b , *f t _ x] = at) = t"} (20) 



and 



7#t(<°) 



E 



|W |' 
1 



™aeT5 a (t») 

^ IWJ' 
E^CO^SSj^^ak), 



= E^Vs* is.^KIa). (21) 



x-Psf.sjIStCat.Stlat) 

= A-t|St > T t ^(y^t ) *?,<?) (17) 

where the first equality is verified by (|2), where x\ = t\(s\) 
for i — {a, b}, and by {St} being i.i.d. and independent of 



W. Now, let x(e) := n f^Ie) and combining (fT~5l> - dT6b gives 



1 



i? a + i? b = -log(|>V a ||>V b |) 

n 

11 



t=i 

( ) 1 1 71 

^ — e -E / ( T * a ' T * fc ; y 'i%]) + 7 ?( £ ) 

-T37-E J ( T t a ' T ^ F ^w) 
{=i 



1 n 

-^2HTt a ,T t b ;Yt\S [ t ] ) + V (e) 



(18) 



Lemma 2: For every 1 < t < n and cr e (S)*' , the 
following holds 



T» T, 



^.Stls^V^sk) 



= Ps(a)iV|s,r»,T»(l/|a J * ,t 6 K.(t a K»(* 6 )- ( 22 > 
Proof: Let s := (s, s" , s') and observe that 



^Tj-.yt.Stl^t-ij^V :y>«|a) 

= E E ^S,T.,T»,y|S [t _ 1 ](s ) t° > * 6 > Wk) 
s?G5" s J G S b 

-EE A|s,T»,^(y|s,i a ,t b ) 



s f a es« s t e sb 



xP s>T . >T »| S[t _ I1 (s,t a ,t ,, |(7) (23) 

where the second equality verified by (O since x\ = 
t\(s\) for i = {a, b). Let us now consider the term 



Ps,T a ,T b \S [t _- L] ( s i *°! t W) above. We have the following 



-fs,T",T<>|5 , [t _ 1] (M < V W) 

= E E EE 

p W,S»_ 1] ,S|' t _ I] ,S,r«,Tf|S [t _ 1] (w,CT a ,(7b,S,t a ,t b |cr) 

= w E E EE 

■ P W,S^_ 1] ,S* t _ 1] ,T«,T''|S [t _ 1] ( w ; °a, °b, *°i * | CT ) 
( =F s (s) ^ ^ EE 1 ^! ^,^), i=o,6} 
xi, w,fir._ 1] ,s»_ 11 |S [t _ 1 i(w, £ r a ,(7 b |(r) 

= -Ps(s) ^ ^ EE^C^f'lio^,), ;=a,6} 

i»«ew a i«i£Wi ere, o-b 
11 

X W\ W\ ^-^-^-^'^ 

cr a Cb 

^ lWJ 1 {t a =' I, l a WO} E jwT^tt^'K,^)} 

«.eT; m (f) 1 a| 



ffb toi.eT'jt 1 ') 

o"b 

( = l) P s (s)^(r)7r^(t b ) 



|W b 



(24) 



where (i) is valid since the current state is independent of W 
and (T a ,T b ), (ii) is valid by ( fTTT l. (m) is valid since W is 
independent from the state processes, (iv) is valid by ([TJ and 
(fTTT l. (v) is valid due to ( fZOl i and (m) — (mi) is valid due to 
(|2TT >. Substituting ( f24l i into (|23T l proves the lemma. ■ 
We can now complete the proof of Theorem |2] With Lemma 
[JJ it is shown that the sum of any achievable rate pair can be 
approximated by the convex combinations of rate conditions 
given in (0 which are indexed by a G and satisfy (01 for 
joint state-input-output distributions. More explicitly, we have 

Ra+Rb < OrlpTrtiYtlSuSw = a) + 77(c) 

cr6S("> 

< sup I(T t a ,T t b ;Y t \S t ) + r,(e) 

(^a(^)^ b (« 6 ), 

< sup 7(7^;^)+^) 

(7r T a(t») 7 r Tb (tf')en) 



where the second step is valid since /(T t a , T b \ It |S* , S[ t -i] = 
a) is a function of the joint conditional distribution of channel 
state St, inputs T t a , T b and output Y t given the past realization 
(Sft-ij = a). Hence, since lim^oo 77(e) = 0, any achievable 
pair satisfies R a + R b < sup^^ b{tb) I(T a ,T b ;Y\S). ■ 
As a direct consequence of Theorem [2] we have the following 
corollary. 
Corollary 1: 



r FS _ 

c E - 



sup I{T a ,T b ;Y\S). 

Tr T a(t a )n Tb (t b ) 



Remark 1: One main observation about the proof of The- 
orem 12 is the fact that, once we have the complete state 
information, conditioning on which allows a product form 
on T a and T b , there is no loss of optimality (for the sum- 
rate capacity) in using associated memoryless team policies 
instead of using all the past information at the receiver. This 
fact is observed in [11] when the information at the encoders 
are asymmetric quantized version of the information at the 
decoder. 

Remark 2: It should be noted that the main difference 
between the problem that we consider here and the one 
considered in fTTJ is the information at the decoder about 
the information at the encoders. More explicitly, in [11], the 
information at the encoders are available at the decoder and 
as such, as the authors explicitly mention in their paper, the 
decoder does not need to estimate the coding policies used 
in a decentralized time-sharing. From this perspective, the 
main contribution of our work can be thought as showing 
that when this is not the case, by enlarging the input space, 
there is no loss of optimality (for the sum-rate capacity) if the 
optimization is performed by ignoring the past information at 
the encoders given that the decoder has complete CSI. 

III. Conclusion and Remarks 

The present paper has investigated the memoryless FS-MAC 
with asymmetric noisy CSI at the encoders and complete 
CSI at the decoder. Single letter inner and outer bounds 
are presented when the channel state is a sequence of i.i.d. 
random variables. The main contribution of the paper, i.e., the 
tight converse for the sum-rate capacity and hence an outer 
bound to the capacity region, is realized by observing that 
the information available at the decoder is enough to attain a 
product form on the channel input functions and hence there 
is no loss of optimality if we ignore the past noisy state 
information at the encoders. 
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